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ABSTRACT 

S'ifari is a cooperative project involving four Quebec 
universities, two industrial partners (Virtual Prototypes, Inc., 
providing the VAPS software package, and Novasys, Inc., a consulting 
firm specializing in artificial intelligence and training), and 
government. VAPS (Virtual Applications Prototyping System) is a 
commercial interface-building and simulation system. The main 
objective of Safari is to develop a methodology and an environment 
for the creation of tutoring systems to be used in professional 
training. The focus is on teaching mostly procedural knowledge 
concerning the operation of devices such as medical instruments, 
manufacturing robots, consumer appliances, control instruments, 
aeronautical instruments, etc. The basic idea is to add a tutoring 
component on top of device models (microworlds) built in VAPS. TI*is 
permits the use of models written in VAPS ("virtual instruments"), 
instead of the real, expensive devices, for training and practice. 
The distinguishing features of the Safari environment are that: (l) 
an attempt is made to represent knowledge at two levels: at the 
physical level corresponding to a simulated device, and the plan 
level; (2) tutoring is based on four instructional modes: 
demonstration, exploration, coaching, and critiquing; and (3) within 
every mode the development of progressively more complex prototypes 
is foreseen, and tutoring in every mode involves the two levels of 
knowledge representation. The evolution of prototypes can be roughly 
divided into three phases according to the complexity of the 
knowledge structures involved, each of which is outlined. Safari 
prototyping of the Flo-Gard 6201 Volumetric infusion pump is descried 
as an example. Three figures illustrate concepts and the infusion 
pump prototype. (MAS) 



U.S. DEPARTMENT OF EDUCATION 
Office of Educational Research and improvement 



EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIO 



SAFARI: an Environment for Creating 
Tutoring Systems in Industrial Training 



J. GECSEI and C. FRASSON 
D6partement IRO 
Universite de Montreal, CP 6123, Montreal, Quebec, H3C 3J7, Canada 
email: gecsei@iro.umontreal.ca 



r This document has been reproduced as 
received from the person or organization 
originating it 

r Minor changes nave been made to improve 
reproduction qustHy 



• Pomls of view or opinions stated m this docu- 
ment do not necessarily represent official 
OE Ri position or policy 



Abstract: Safari is a cooperative project involving universities, industrial 
partners and government. It aims at developing various architectures for 
industrial training,- with different levels of complexity. The distinguishing 
features of the Safari environment are that (a) an attempt is made to 
represent knowledge at two levels: at the physical level corresponding to a 
simulated device, and the plan level; (b) tutoring is based on four 
instructional modes: demonstration, exploration, coaching and critiquing; (c) 
within every mode the development of progessively more complex 
prototypes is forseen, and tutoring in every mode involves the two levels of 
knowledge representation. 



Creating tutoring systems remains difficult for various reasons: the different components of 
their architecture are not stabilized, the structure and type of knowledge to be used are of different 
granularity and complex to handle, and they require multiple expertise which is difficult to inteqrate 
[Fath et al. 1 990, Lesgold et al. 1 992]. y 

The utility of tutoring systems having more or less intelligent capabilities is obvious. Most 
intelligent tutoring systems have been designed for academic domains such as mathematics physics 
and computer programming. Although we do not lack teachers in such domains, there is still a well- 
known need for improving the quality of teaching in universities and colleges. However there is an 
even more urgent need for computerizing industrial training. In todays global industrial competition 
the skills required from workers are rapidly changing with the shifting technological environment and 
employees must acquire new know-hows in limited time. The problem is compounded by a 
permanent lack of qualified instructors. For this reason, the research undertaken in the Safari project 
is focused on developing a tool set for the rapid construction of various tutors for industrial training 
t u I '5 ~ p . r0ject u , nder the aus P' ces of Synergie, a programme sponsored by the Ministry of 
Technology and Science of the Governement of Quebec. The main objectives of Synerqie are (11 to 
enhance cooperative research and development between universities and industry, (2) to accelerate 
the product development cycle. (3) to facilitate the transfer of knowledge between research 
establishments and industry, and (4) to educate highly qualified professionals in the domain. Safari 
involves four Quebec universrties, two industrial partners and a government agency. The industrial 
partners are Virtual Prototypes Inc., providing a software package VAPS and Novasys Inc a 
consulting firm specialized in the Al and training domains. VAPS (Virtual Applications Prototyping 
SKf m) 18 J 1 h'gh-qua'ity commercial interface-building and simulation system, used in many areas 
(such as industrial design and evaluation of airline cockpits). 

p« C o~ T / he • Sa !^ ri ^'"includes seven professors conducting research on a part-time basis : C 

atoS^ffS? SfSPn - i a T & !' G - lmbeaU ' M - K*enbach. & Laft and B. Lefebvre 

uSr^ i ? Z h - D s ^ udents - two Ml*™ programmers and several engineers provided by the 
industrial partners. The project time frame spans 4 years (1993-96). 1 
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Building reasonable tutoring components 



The main objective of Safari is to develop a methodology and an environment for the creation 
of tutoring systems to be used in professional training. The focus is on teaching mostly procedural 
knowledge concerning the operation of devices such as medical instruments, manufacturing robots, 
consumer appliances, control instruments, aeronautical instruments, etc. 

The basic idea is to add a tutoring component on the top of device models (mhroworlds) built 
in VAPS. This permits the use of models written in VAPS (Virtual instruments"), instead of the real 
devices, for training and practice. Thus the expensive machinery can be kept for its actual purpose 
and damages from incorrect manipulations during learning can be prevented. Safari can be seen as a 
value-adding component attached to the VAPS package, making it into an integrated toolkit for the 
creation of device models together with a corresponding computerized training course on how to 
operate the device. Since a large base of VAPS device models are already available, these can be 
conveniently used to validate the Safari approach. 

In order to remain within the bounds of practicality, we limited a priori the target applications to 
devices which have the following characteristics: 

- They permit the definition of a set of clearly distinguishable interaction procedures (e.g. through 
control panels, switches). 

- The device functions are decomposable into a number of well-defined tasks, each task 
corresponding to a meaningful operation in terms of the device's main purpose. 

These characteristics exclude very complex equipment such as nuclear reactors (although 
parts of it may be covered) and devices whose operation requires hard to enumerate, "look-and-feeP 
actions such as handling certain manufacturing machines, or performing surgery. 

Tutoring systems created in the Safari environment will be capable of : 

- tutoring workers in an industry (factory, hospital) through real tasks recreated on device models 
using the VAPS software, 

- constructing models of individual users, reflecting the user's reasoning style and level of 
knowledge, 

- dispensing individualized and adaptive tutoring based on the user model, 

- diagnosing the actions of a trainee when asked to perform a task on the virtual instrument, and 

- composing an entire curriculum for teaching the operation of the device, taking into account the 
learner's expertise and style of learning. 

Some distinguishing features of Safari are that 

- it involves contractual cooperation between the industrial and university partners who are committed 
to a binding schedule including the development of commercially viable products, 

- the proposed methodology is applicable to a large class of devices and domains, not only to a single 
device type, 

- it is based on an existing software package VAPS, and 

- it enhances learning by using multiple representations of knowledge, and by encouraging the 
learner to pass between them. 

We do not aim exclusively at deeply intelligent tutoring; this would be somewhat unrealistic, 
given the limited success and the problems such systems have even within narrow application 
domains. Instead, Safari provides a combination of some existing tutoring approaches to build easily 
and rapidly a tutoring system for a given device. 

A realistic training sequence 

Throughout the project time frame we use the following functional paradigm. In Safari, 
tutoring functions (modes) are based on the observation that the natural cycle in which most people 
acquire a given skill is by first observing someone's demonstration of the skill, then freely 
experimenting with the device in question (given the availability of the device, and that such 
experimenting is not hazardous), then executing precise tasks (assignments) in terms of the device 
functionalities under the guidance of an expert, and finally by describing the learned skill in an 
abstract form (which can be used as a basis for a critical examination by an expert, or for 
communicating to other people). 
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Somewhat simplifying, in our approach this translates into four distinct tutoring modes: 
demonstration, free exploration, coaching and critiquing. These modes are presented to the learner 
through an interface which is similar in all modes, and which displays two major windows: the Device 
Window showing the simulated device, and the Plan Window showing an abstract representation of a 
task called task graph. In this arrangement the learning process involves two related views of the 
learning space, encouraging the learner to develop his knowledge simultaneously on the concrete 
and abstract level. This method has its origin in the TIP approach to tutoring, described in fFrasson 
et a/. 1992]. PIF supports three interrelated •worlds" (i.e. levels of representation): the Ehysical, 
Intentional and functional. In Safari we retained the P and I worlds, corresponding to the Device and 
Plan windows. 

In demonstration mode, the student can observe the execution of various tasks applicable to 
the device, somewhat like a videotaped demonstration. However, in Safari the demonstration is 
based on the VAPS model, executing automatically a task graph (TG) which had been edited by a 
human expert. A demonstration scenario is a TG augmented by hypermedia comments and 
explanations attached to certain elements of the TG. The student can navigate in the scenario by 
stopping, repeating, jumping to an arbitrary point (i.e. by clicking on an action in the TG), and by 
asking for hypermedia explanations. However, he cannot interact directly with the simulated device 
only with the scenario. As the demonstration progresses, actions in the TG are highlighted along with 
the corresponding simulated manipulations of the device (such as operating the controls). 

The purpose of exploration mode is to permit direct interaction with the microworld (virtual 
device). Here the learner is allowed to freely experiment with the device, to observe the 
consequences of his actions in a realistic environment, but without the inconveniences of 
experimenting with the real device [Fath et ai. 1990]. The system may attempt to determine which 
task the learner is trying to execute; in this case the TG of the conjectured task is gradually displayed 
in the task window according to the learner's progress in manipulating the device. Exploration can 
also be done within the context of a given task; then the student is allowed to interact with either 
window, with automatic highlighting of the corresponding actions in the other window. 

In coaching mode the student is asked by the system to perform a given task or to sotve a 
given problem scenario (^sequence of tasks) by interacting only with the Device Window. Initially the 
correct TG is hidden; it is gradually revealed as the learner's solution is being built. The process is 
supervised by a coaching component, essentially analyzing the difference between the correct 
solution(s) from the knowledge base and the learner's construction, and generatinq appropriate 
coaching interventions. 

The fourth tutoring mode is critiquing, where the learner has to prove his knowledge by 
constructing a solution in the form of a TG for a given problem. The learner can 'experiment* in the 
device window as in exploration mode, and build the solution in the Task Window. In this way he is 
encouraged to pass frequently between alternative representations in the two windows; in other 
words, the student has to prove not only that he can correctly execute a task, but also that he 
understands (to a certain degree, of course) what he is doing. By requesting the student to construct 
a TG, he is effectively asked to express his knowledge in an abstract form. When the proposed 
solution is complete, a critiquing component (similar to the coach) will comment on the solution 
At any time during work in the above tutoring modes, the student can ask for help (non-contextual) or 
contextual advice. ' 

Evolution 

As shown in Figure 1 , the four tutoring modes are considered as evolving in time from minimal 
versions to more sophisticated. In this way we can keep the project consistent over a period of time 
and by producing a series of prototypes of increasing complexity we can exploit the experience 
learned on the way. We firmly believe that a well functioning complex system can be created only by 
evolving through simpler versions. The evolution of prototypes can be roughly divided in three 
phases according to the complexity of the knowledge structures involved. In the following, we briefly 
charactenze these phases. y 



ERIC 



17 

4 



sophisticated 

Demonstrate Explore 




Figure 1. Safari tutoring modes and evolution. 

Phase 1 : In Phase 1, task graphs are equivalent to flowcharts containing two kinds of nodes: Action 
(A) and Observation (O) nodes [Mittal et a/. 1 988]. Actions are operations to be executed by the user, 
Observations serve as decision points where the following action depends on some observable 
behavior of the device. There is one TG per task, and all tasks can be clearly distinguished. The 
knowledge base consists of the set of corresponding TGs. A demonstration is a pre-recorded 
manipulation of the VAPS virtual device; in exploration mode the student can interact freely with the 
model. Coaching and critiquing are based on overlay-like comparisons of the student's input and the 
correct TG from the knowledge base. Even so, some nontrivial comments can be generated such as 
"Your solution is almost correct, except that you inversed actions A and B." 

Phase 2: Here, we will take into account some factors that make the model of Phase 1 overly 
simplistic. First, in many cases there is more than one way to accomplish a task. These ways may be 
equivalent, or can have different attributes in terms of efficiency, cost, etc. We have to deal with this 
multiplicity in terms of efficient knowledge base representation and retrieval mechanisms. Second, 
the VAPS-based virtual device may be insufficient for efficient coaching and critiquing interventions 
which may need, for example, causal explanations. To achieve this we will introduce a cognitive model 
of the device, complementary to the lower level VAPS model. In Phase 2, the internal representation 
of knowledge (tasks, cognitive device model) will be based on concepts and relations integrated in an 
object structure. A simple student model (overlay) will permit to individualize tutoring interactions. 
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Phase 3: Here, tutoring will involve other types of device knowledge, such as structural, functional 
and maintenance. In further experimenting with the coaching and critiquing modes, we will emphasize 
the idea of having the learner gradually create and refine his knowledge simultaneously on two levels 
(instead of just showing a task and asking him to prove his knowledge). The student model will penr.it 
o infer the students reasoning from his actions and adapt the coaching interventions accordingly' 
f n e n ^ a ttem P t to make certain types of knowledge transferable to new situations [Wielinga et al 
1 992]. Figure 2 shows the main functional blocks of the Safari system 
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Figure. 2. Safari functional architecture. 



Each component will gain in complexity in successive phases. The architecture is orqanized 
in a way that makes it possible to implement a layered development of the components. Each 
component contains a base to which a more complex module can be attached • PrototvDe 
implementation is under way on Sun and Silicon Graphics workstations. The two main programming 
bnguages used are VAPS (used for the virtual device and the demonstration editor) and Smalltalk 
(used for the other components). ' 



Implementation: example 



Ron- w , ? w f ' r ? 1 devices "f* 1 for Safari Prototyping is from the medical domain: the Flo-Gard® 
6201 Volumetnc infusion pump fabncated by Baxter Healthcare Corporation. The device used mostly 
in emergency rooms can deliver a variety of fluids over a broad range of infusion rates. The rates can 
nlH^f mme ? ,r \ d,fferent ™ a l s > sucn as over a Axed period of time, or with constant rate until a 
w T^l w f ^ 6 .? reached - or as a sequence of infusion programs. The machine can control 
two independent simultaneous infusion processes. During an infusion, a number of special events 

ntl^t U \ S " C - 88 la ? ° f flui( ! L" th8 reservoir . or a " a ^ bubble in the infusion tube/The trainees 
(heatth technicians and nurses) have to learn the basic open ting procedures, as well as to handle 

X2*ri?MPa 6 Wind ° W ° n ,6ft ° f R9 ' *' * ' ™ ?he fr ° nt P^nel oflhe pump t 
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A cognitive analysis of the learning situation resulted in some 20 tasks which are expressed 
as task graphs. Related tasks are regrouped in curriculum issues; these were in turn classified 
according to their degree of difficulty (novice, intermediate, advanced). The righthand side of Fig. 3 
contains a scenario editor used for creating a demonstration of a given task. This type of 
demonstration consists of actions (pre-recorded manipulations of the virtual device, represented by 
trace-footstep icons), and written and spoken comments (pre-recorded files represented by 
appropriate icons). The editor permits to arrange the icons in a desired presentation sequence. When 
an action is being replayed, the corresponding manipulations of the device controls (switches, keys) 
are visualized by the hand icon moving to the appropriate places, and by highlighting the activated 
controls. 




Figure 3, Infusion pump demonstration scenario editor. 
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